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(57) Abstract: A multilevel optical receiver ( 1 50) can comprise a plurality of comparators (405) that generally correspond with the 
number of levels in a multilevel data stream. Each comparator (405) can be individually controlled and fed a decision threshold in 
order to decode a multilevel signal. The multilevel optical receiver (150) can generate a statistical characterization of the received 
symbols in the form of a marginal cumulative distribution function (CDF) or probability density function (pdf). This characterization 
can be used to produce a set of e-support estimates from which conditional pdfs are derived for each of the transmission symbols. 
These conditional pdfs may then be used to determine decision thresholds for decoding the received signal. The conditional pdfs 
may further be used to continuously estimate the fidelity or error rate of the received signal without the transmission of a testing 
sequence. The e-supporls may further be used to automatically control the gain on the receiver. 
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METHOD AND SYSTEM FOR DECODING MULTILEVEL SIGNALS 



CROSS REFERENCE TO RELATED APPLICATIONS 

The present application claims priority under 35 U.S.C. § 119(e) to U.S. 
Provisional Application Serial No. 60/281,526 entitled, "Automatic Threshold 
Tracking and Digitization Method for Multilevel Signals," filed on April 4, 2001 in 
the name of Hietala et al. The entire contents of which are hereby incorporated by 
reference. This application is also related to U.S. Non-provisional Application Serial 
No. 10/032,586 entitled, "Increasing Data Throughput in Optical Fiber Transmission 
Systems," filed on December 21, 2001 . 

FIELD OF THE INVENTION 

The present invention relates to optical fiber communication systems and 
increasing the throughput of data transmission over an optical fiber communication 
system through the use of multilevel modulation. Specifically, the present invention 
relates to a method and system for demodulating multilevel signals. 

BACKGROUND OF THE INVENTION 

The use of multilevel signals in an optical network architecture increases 
channel data throughput rates without requiring replacement of the existing optical 
fiber in a link (i.e., the optical fiber plant). While multilevel signals can offer this 
advantage of increased channel data throughput rates to an optical network 
architecture, conventional hardware and software used to decode the multilevel signal 
often cannot achieve this advantage because of difficulties in establishing thresholds 
by receivers for a multilevel signal. These thresholds are needed by the receiver to 
decode the multilevel signal into the one or more symbols that make up the multilevel 
signal. 

The difficulties in establishing the thresholds are associated with reliably 
characterizing the noise that is present within a multilevel signal. Further, 
conventional hardware and software do not address multilevel signals comprising 
greater than two-level data streams. That is, the conventional art only provides 
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methods for automatically controlling the threshold or decision points for traditional 
two-level data streams. 

The voltage detection thresholds or decision points of multilevel receivers are 
usually centered in a statistical center of each of the troughs of a graphical 
5 representation of a marginal probability density function (pdf) that corresponds to the 
"eyes" of an "eye diagram" for a multilevel signal in order to minimize the number of 
decoding errors. Since the troughs or "eyes" of a pdf are usually not uniformly 
distributed in voltage, a simple conventional direct analog-to-digital conversion 
(ADC) at a minimum number of bits is not adequate for decoding a multilevel signal. 
10 Conventional receivers for decoding two-level multilevel signals frequently 

assume additive noise with parametric noise distributions such as a Gaussian 
distribution. Conventional receivers for decoding two-level multilevel signals also 
usually assume simple linear dependencies on the transmitted two-level multilevel 
signal. 

15 However, the noise in optical channels of a multilevel signal may have 

distributions that are non-Gaussian. Further, the distortion of multilevel signals may 
be nonlinear in nature resulting in asymmetric or multi-modal pdfs for the received 
signal. 

In addition to the problems associated with estimating noise distributions in a 
20 multilevel signal, another problem exists in the conventional art with respect to 
reliably determining the fidelity of a received multilevel signal without the explicit 
transmission of a testing" data sequence that is already known to the receiver. 
Conventional performance monitors can generally be categorized into one of two sets. 
The first set are those that use a secondary threshold (or sampling phase) to 
25 approximately determine how often a received symbol is near to the primary threshold 
(or sampling phase) used for decoding. When the detected sample from this second 
threshold differs from the primary sample, a pseudo-error is said to have occurred. 
The link is then characterized with the pseudo-error rate. This class of approaches, 
however, neglects the fact that under optimal filtering, the primary and secondary 
30 samples will be heavily statistically correlated, and thus, misrepresents the link 
performance. 
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The second set of performance monitors of the conventional art are those that 
rely on acquiring statistics from an error correction module. Specifically, forward 
error correction coding is used at the transmitter to allow the receiver to correct a 
small number of errors. If the true number of errors incurred during transmission is 
5 sufficiently small, then the receiver can correct all of the errors and report the rate at 
which errors occur. This class of performance monitors, however, suffers two 
significant drawbacks. 

First, these methods require the use of an error correction code so that errors 
can be detected. The second drawback is that transmission errors must occur in order 

10 to acquire statistics regarding their frequency of occurrence. By the very nature of the 
high quality of the link, these errors will rarely occur, and thus, the performance 
monitor requires a significant amount of time to reliably report the error rate. 

In view of the foregoing, there exists a need in the art for a multilevel signal 
receiver that does not assume a particular noise distribution in a received multilevel 

15 signal. That is, a need exists in the art for a multilevel signal receiver that employs 
robust estimates of noise distributions in order to process complex signal distortions 
that may be present in a multilevel signal while maintaining high performance for 
classic Gaussian noise distributions that may also be present in a multilevel signal. 
Aspects include the need in the art for (1) a method and system for automatically 

20 selecting the decision thresholds for a multilevel signal receiver on an adaptive basis, 
(2) a multilevel signal receiver that can process multi-modal conditional probability 
density functions, and (3) a method and system for decoding multilevel signals that 
can provide a reliable fidelity measure of the received signal without the transmission 
of explicit error testing sequences known to the receiver. In other words, a need 

25 exists in the art for a complete statistical characterization of link noise to reliably 
establish decision thresholds and infer error rates without suffering from the 
aforementioned drawbacks of the conventional art. 



SUMMARY OF THE INVENTION 
30 The present invention solves the aforementioned problems by providing a 

system and method for decoding multilevel signals. More specifically, the present 
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invention is generally drawn to a method and system for selecting an optimal set of 
decision thresholds that can be used by an optical receiver in order to decode a 
multilevel optical signal. In one exemplary embodiment, the multilevel optical 
receiver can comprise a plurality of comparators that generally correspond with the 
5 number of levels in a multilevel data stream. Each comparator can be individually 
controlled and fed a decision threshold in order to decode a particular channel from a 
multilevel signal. 

Unlike conventional optical receivers, the present invention can automatically 
control the thresholds or decision points for comparators of multilevel optical 

1 0 receivers that process multilevel data streams, where the noise corrupting the received 
signal is not necessarily Gaussian, signal independent, nor time-invariant. In other 
words, multilevel data streams can be distorted by noise where the noise follows a 
non-Gaussian probability distribution whose parameters depend on the transmitted 
signal values and vary with time. However, the present invention can still effectively 

15 process multilevel signals that have Gaussian, time-invariance, or signal- 
independence characteristics. 

According to one aspect of the present invention, a multilevel optical receiver 
can comprise a plurality of voltage comparators* a decoder, a latch, an analog low- 
pass filter coupled to the latch, and a low-speed high resolution analog-to-digital 

20 converter coupled to the low-pass filter. With such structure, the multilevel optical 
receiver can generate an estimate of a cumulative distribution function (CDF) based 
on the received multilevel data signal. 

The CDF can completely characterize the received multilevel data signal. 
From the CDF, the optical receiver can further generate an equivalent marginal 

25 probability density function (pdf) which is used to determine a near-optimal set of 
decision thresholds. A marginal pdf can be defined as an "overall" pdf characterizing 
the received signal when random symbols are transmitted. A marginal pdf can 
comprise one or more conditional pdfs. A conditional pdf is the pdf for an individual 
symbol of a multilevel signal, i.e. the pdf of the received signal conditioned on a 

30 particular symbol being transmitted. 
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Instead of using the calculated pdf to determine an optimal set of thresholds, 
the CDF function itself in one exemplary embodiment can be used to determine the 
decision thresholds as it conveys the same information as the pdf but in a less intuitive 
form. In either case, the invention can assist with centering the voltage detection 
5 thresholds for each of the plurality of comparators. In the pdf exemplary 
embodiment, the invention can center the voltage detection thresholds at the troughs 
or local minima of the pdf (or equivalently at the points of inflection of the CDF) 
which correspond to near-optimal decision thresholds for the received signal. In this 
way, the probability of error in the detection of the individual symbols that make-up 
10 multilevel signal can be minimized. 

The centering of voltage detection thresholds based upon the calculated pdfs 
can involve several different steps. In one exemplary embodiment, a first step can 
comprise calculating an initial set of e-support estimates corresponding to ranges of 
received voltages of significant probability for receiving a particular symbol. Next, 
15 the e-support regions are combined until there is a 1-to-l correspondence between the 
transmitted symbol levels and the e-support regions: Possible threshold candidates 
can then be determined by establishing the threshold between the e-support regions. 

According to another aspect of the present invention, a multilevel optical 
receiver can comprise a plurality of voltage comparators, an analog low-pass filter, 
20 and a low-speed high resolution analog-to-digital converter coupled to the low-pass 
filter. According to this exemplary aspect, a latch that can be coupled to the low-pass 
filter has been removed. The removal of this latch can change the region of the signal 
that is being characterized. Specifically, latching the comparator output focuses the 
CDF/pdf characterization to the portion of the signal synchronized with the system 
25 clock and decision output. By removing the latch, the statistical characterization 
applies to the entire received signal and not just that portion which is used for the 
decision output. 

For an alternative exemplary embodiment of the present invention, the CDF 
and pdf can be generated in a digital fashion (rather than the analog fashion described 
30 above) by using a track-and-hold circuit or a sample-and-hold circuit. The track-and- 
hold circuit or the sample-and-hold circuit can sample an input multilevel data signal 
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and accumulate the samples over time. These samples can then be digitally processed 
to provide either a marginal pdf or CDF. As before, the CDF or pdf may then be 
used to determine the decision threshold voltages. 

According to another alternative exemplary embodiment of the present 
5 invention, a high-resolution analog-to-digital converter (ADC) can measure the 
voltage of the received multilevel signal. The digitized multilevel signal can be 
provided to a digital signal processor (DSP) which computes the pdf and decision 
thresholds. The DSP can then use the computed thresholds to decode subsequent 
symbols digitized from the multilevel signal. 

10 Those skilled in the art will recognize that different hardware or software or 

both can be substituted for the exemplary embodiments described herein without 
departing from the scope arid spirit of the present invention. Specifically, as long as 
the hardware or software (or both) performs the functions described herein, then those 
skilled in the art will appreciate that the present invention would be embodied in such 

1 5 alternative hardware or software or both. 

A further aspect of the invention can include calculating the fidelity of a 
multilevel signal based upon an estimated marginal pdf. Specifically, the marginal 
pdf can be used to estimate a set of conditional pdfs (one for each candidate symbol of 
a multilevel signal). These conditional pdfs can then be used to estimate the 

20 probability of error for each symbol and hence the system as a whole. This aspect of 
the invention allows for error performance to be measured without explicit error tests 
that require testing sequences (known to the receiver) to be transmitted. 

BRIEF DESCRIPTION OF THE DRAWINGS 
25 Figure 1 is a bock diagram of a fiber optic link constructed in accordance with 

an exemplary multilevel optical signal system. 

Figure 2 is a block diagram of an exemplary multilevel optical receiver 
according to an exemplary embodiment of the present invention. 

Figure 3 A is a diagram showing a representative example of an ideal 16-level 

30 signal. 
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Figure 3B is an exemplary simulated received signal displaying the signal in 
Figure 3 A transmitted through 80km of optical fiber. 

Figure 3C illustrates an exemplary Eye-diagram for 4,096 simulated symbols 
received through 80km of optical fiber. 
5 Figure 4 illustrates a block diagram of an exemplary embodiment for a 16- 

level multilevel optical receiver. 

Figure 5A illustrates a block diagram of another exemplary embodiment for a 
16-level multilevel optical receiver. 

Figure 5B illustrates a block diagram of yet another exemplary embodiment 
10 for a 1 6-level multilevel optical receiver. 

Figure 5C illustrates a block diagram of yet a further exemplary embodiment 
for a 1 6-level multilevel optical receiver. 

Figure 6A illustrates an exemplary cumulative distribution function (CDF) for 
the received signal of Figure 3C sampled at the horizontal eye-center. 
15 Figure 6B illustrates an exemplary marginal probability density function (pdf) 

for the received signal of Figure 3C sampled at the horizontal eye-center. 

Figure 7 illustrates a block diagram of alternative exemplary embodiment for a 
16-level multilevel optical receiver. 

Figure 8A illustrates another exemplary eye diagram for simulated data of a 
20 1 6-level transmission. 

Figure 8B illustrates a histogram of the data shown in Figure 8A. 
Figure 9 is an exemplary logic flow diagram illustrating a method for 
decoding a multilevel signal. 

Figure 10 is an exemplary logic flow diagram illustrating a sub-method of 
25 Figure 9 for calculating a cumulative distribution function according to an exemplary 
embodiment of the present invention. 

Figure 1 1 is an exemplary logic flow diagram illustrating a sub-method of 
Figure 9 for calculating a marginal probability density function according to an 
exemplary embodiment of the present invention. 
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Figure 12 is an exemplary logic flow diagram illustrating a sub-method of 
Figure 9 for calculating a marginal probability density function according to alternate 
exemplary embodiment of the present invention. 

Figure 13 is an exemplary logic flow diagram illustrating a sub-method of 
5 Figure 9 for calculating one or more decision thresholds according to; an exemplary 
embodiment of the present invention. 

Figure 14 is an exemplary logic flow diagram illustrating a sub-method of 
Figure 9 for calculating the fidelity of a multilevel signal according to an exemplary 
embodiment of the present invention. 
10 Figure 1 5 illustrates a graph of an exemplary measured pdf for an N=16 level 

multilevel signal according to an exemplary embodiment of the present invention. 

Figure 16 illustrates a graph of an exemplary initial pdf estimate for an N=16 
level multilevel signal according to an exemplary embodiment of the present 
invention. 

1 5 Figure 1 7 illustrates a graph of an exemplary revised pdf estimate for an N=l 6 

level multilevel signal according to an exemplary embodiment of the present 
invention. 

Figure 18 illustrates a graph of the log-likelihood ratio of an exemplary initial 
pdf estimate over the measured pdf for an N=16 level multilevel signal according to 
20 an exemplary embodiment of the present invention. 

Figure 19 illustrates a graph of the log-likelihood ratio of an exemplary 
revised pdf estimate over the measured pdf for an N=16 level multilevel signal 
according to an exemplary embodiment of the present invention. 

Figure 20 illustrates a graph with a measured pdf along with decision 
25 thresholds and fidelity characterizations for an N=l 6 level multilevel signal according 
to an exemplary embodiment of the present invention. 

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 

The present invention can select a near-optimal set of decision thresholds that 
30 can be used by an optical receiver in order to decode a multilevel optical signal. The 
multilevel optical receiver can comprise a plurality of comparators that generally 
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correspond with the number of levels in a multilevel data stream. Each comparator 
can be individually controlled and fed a decision threshold in order to decode a 
particular symbol from a multilevel signal. Alternatively, a high-resolution analog-to- 
digital converter (ADC) can measure the voltage of the received multilevel signal. 
5 The digitized multilevel signal can be provided to a digital signal processor (DSP) 
which computes the pdf and decision thresholds. The DSP can then use the computed 
thresholds to decode subsequent digitized symbols from the multilevel signal. 

The present invention typically does not require the assumption of 
Gaussianity, time-invariance, signal-independence, or binary signaling. Contrary to 

10 the conventional art, the invention is designed to perform well when these 
assumptions do not hold. However, the present invention can also perform well if the 
assumptions do hold or are valid. 

A CDF can completely characterize the received multilevel signal data. From 
the CDF, the optical receiver can further generate an equivalent marginal probability 

15 density function (pdf) which is used to determine an optimal set of decision 
thresholds. A marginal pdf can be defined as an "overall" pdf characterizing the 
received signal when the symbol transmitted is unknown. A marginal pdf can 
comprise one or more conditional pdfs. A conditional pdf is the pdf for an individual 
symbol of a multilevel signal, i.e. the pdf of the received signal conditioned on a 

20 particular symbol being transmitted. 

The determining of voltage detection thresholds based upon the calculated 
pdfs can involve several different steps. In one exemplary embodiment, a first step 
can comprise calculating an initial set of e-support estimates that comprise ranges of 
received voltages. Next, the e-support regions are combined until there is a 1-to-l 

25 correspondence between the transmitted symbol levels and the e-support regions. 
Possible threshold candidates can then be determined by establishing the threshold 
between the e-support regions. 

Referring now to the drawings, in which like numerals represent like elements 
throughout the several Figures, aspects of the present invention and the illustrative 

30 operating environment will be described. 
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Figure 1 is a functional block diagram illustrating an exemplary optical 
network architecture 100 according to the present invention. The exemplary optical 
network architecture 100 comprises a transmitter 110 that includes the circuitry 
necessary to modulate the light source 120 with the incoming multiple channel digital 
data input stream. The light source 120 is usually a laser in the form of a laser diode 
or an externally modulated laser source such as a Mach-Zehnder, or Electro- 
Absorptive modulator. The transmitter 110 takes a set of n high-speed digital binary 
inputs or channels and converts them to a single multilevel digital signal comprising 
2" levels at the same symbol rate (and thus an n times faster data rate) as the input 
data channels. 

The exemplary optical network architecture 100 further comprises an optical 
waveguide 130 that can include one or more spans of optical fiber. The optical 
waveguide 130 couples the light source 120 to an optical detector 140. The optical 
detector 140 can be coupled to a receiver 150 that is responsible for decoding the 
multilevel signal into one or more channels of digital data output. The receiver 150 
takes a single multilevel digital signal comprising 2" levels at the same symbol rate 
and converts the multilevel signal into a set of n high-speed digital binary inputs or 
channels. The receiver 150 typically comprises all circuitry required to operate a 
corresponding optical detector 140 and to amplify the detected signal. Further details 
of the receiver 150 will be discussed below with respect to Figure 2. 

Referring now to Figure 2, this figure illustrates a block diagram of an 
exemplary multilevel receiver 150 according to an exemplary embodiment of the 
present invention that can also be referred to as a desymbolizer. The receiver 150 can 
comprise an optical detector and Translmpedance Amplifier (TIA) circuitry 140. 
Usually, the Translmpedance Amplifier takes a very small electrical current output by 
the optical detector and converts it to a proportional voltage with a moderate intensity 
("moderate" in the sense that it may still need fiirther amplification). As noted above, 
the optical detector 140 coverts an optical signal into an electrical signal. The optical 
detector 140 is coupled to an amplifier 210 that feeds its output into a signal 
conditioning filter 215. The gain of the amplifier 210 can be controlled by a signal 
integrity unit (SIU) 220. 

-10- 
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The optional signal conditioning filter 215 can comprise one or more 
programmable analog signal processing modules such as equalizers and filters. The 
signal conditioning filter 215 is also coupled to and controlled by the SIU 220. The 
SIU 220 can determine the decision or voltage thresholds that are used to decode the 
5 multilevel signal. Further details of various exemplary embodiments of the SIU 220 
will be discussed below with respect to Figures 4, 5, and 7. 

A clock recovery unit 225 can be coupled to the output of the amplifier 210 or 
an optional signal conditional filter 215. The clock recovery unit 225 can generate a 
timing signal that is used to operate an optional holding circuit 230 and an analog-to- 

10 digital converter (ADC) 235. The holding circuit 230 is not required for each of the 
exemplary embodiments. The holding circuit 230 can comprise one of a track-and- 
hold circuit or a sample-and-hold circuit as known to those skilled in the art. The 
holding circuit 230 is coupled to the output of the signal conditioning filter 215. 

Coupled to the output of the optional holding circuit 230 is the ADC 235 

15 which decodes the multilevel signal. The ADC 235 can convert a 2"-level signal into 
n binary data streams. Further details of various exemplary embodiments of the ADC 
235 will be discussed below with respect to Figures 4, 5, and 7. The ADC 235 having 
a decoder 410 (not shown in Figure 2) can convert a coded n-bit word each clock 
cycle into the corresponding w-bit word that was initially input into the transmitter 

20 110. All of these functional blocks, less the optical detector and TIA circuitry 140 
can be integrated into one circuit or on a multi-chip module. 

Background on Multilevel Signals 

Figure 3A is a graph 300 depicting time versus voltage of an exemplary 
25 multilevel amplitude shift keying (ASK) signal 305 that combines four bits into a 
single transmitted pulse, or symbol, possessing one of 16 possible amplitude levels. 
While the present invention contemplates ASK signals, other modulation techniques 
are not beyond the scope of the present invention. Other modulation techniques 
include, but are not limited to, frequency shift keying (FSK), phase shift keying 
30 (PSK), quadrature amplitude modulation (QAM), and other like modulation 
techniques. 
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In Figure 3A, five different amplitude values 310, 315, 320, 325, and 330 are 
shown. Associated with each amplitude value can be a unique w=4 bit word. For 
example, the amplitudes 310, 315, 320, 325, and 330 could be associated with the 
words "0010", "0101", "01 11", "0001", and "0110". Specifically, associated with the 
5 first amplitude value 310 can be the four bit word of "0010." Associated with the 
second amplitude value 315, which is higher in voltage than the first value 310, can 
be the four bit word of "0101 Associated with the third amplitude value 320, which 
is higher in voltage than the second value 315, can be the four bit word of "0111." 
Associated with the fourth amplitude value 325, which is the lowest value out of all 

10 the values, can be the four bit word of "0001." And lastly, associated with the fifth 
amplitude value 330, which is between the second and third values 315 and 320, can 
be the four bit word of "0110." Those skilled in the art will appreciate that other 
words or assignments can be made for each amplitude value of a multilevel signal 
without departing from the scope and spirit of the present invention. 

15 A multilevel signal allows for more than one bit to be transmitted per clock 

cycle, thereby improving the spectral efficiency of the transmitted signal. For 
multilevel optical transmission, some characteristic (i.e., signal property) of a 
transmitted pulse (such as amplitude, phase, frequency, etc.) is modulated over T 
levels in order to encode n bits into the single pulse, thereby improving the spectral 

20 efficiency of the transmitted pulse. Multilevel modulation can increase aggregate 
channel throughput by combining n OOK data streams (each with bit rate, B, in bits/s) 
into one 2"- level signal (with a symbol rate, B, in symbols/s) for an aggregate 
throughput (in bits/s) that is n times greater than B. The aggregate data rate of the 16- 
level signal shown in Figure 3 is four times greater than a corresponding OOK signal 

25 with a bit rate equal to the multilevel symbol rate. As the simplest case, OOK can be 
regarded as a two level multilevel signal where the symbol rate and bit rate are equal. 

As a specific example, the assumption may be made that the 16-level signal in 
Figure 3 has a symbol rate of 2.5 Gsym/s. That is, a pulse e.g., with one of 16 
possible amplitudes (e.g. 310, 315, 320, 325, and 330) is transmitted at a rate of 2,5 

30 Gigapulses/s. Therefore, the aggregate data rate of the 16-level signal is actually 10 
Gb/s (4 x 2.5 Gb/s) because each pulse (i.e., symbol) can represent a distinct value of 
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four bits. The optical components required to transmit and receive a 16-level 2.5 
Gsym/s signal are nearly identical to those required for transmitting and receiving an 
OOK 2.5 Gb/s signal. 

5 Exemplary Portion of a Simulated Received Multilevel Signal 

Referring now to Figure 3B, this figure is a graph 350 of time versus voltage 
depicting an exemplary simulated received 16-level multilevel signal 355 that was 
propagated through 80 kilometers of optical fiber. The received 16-level multilevel 
signal 355 shown in Figure 3B is an illustration of a segment covering eight symbols 
10 of the simulated waveform. The simulated waveform is based on 80 kilometers of 
fiber and an Avalanche PhotoDiode (APD). An APD can convert the optical signal to 
an electrical current whose amplitude is proportional to the received optical power. 
The simulated received multilevel signal 355 illustrates the challenge of directly 
determining the levels of each data stream contained in the signal. 

15 

Exemplary Eye-diagram for Received Multilevel Signal 

Referring now to Figure 3C, this figure is a graph 360 of time versus voltage 
depicting an exemplary n Eye M -diagram 365 for all 4,096 received symbols 
corresponding to the transmitted signal 305 of Figure 3A. Eye diagram 365 

20 comprises the complete data set with all symbol periods overlaid on one another. An 
Eye diagram/Eye pattern comprises the received signal displayed on an oscilloscope 
to show how distinct the received levels are. Often, an "open" eye 370 shows a good 
quality signal with clear differences between levels. A "closed" eye means that some 
levels could be confused for other levels, and therefore is a sign of a poor 

25 transmission system. 

Eye diagram 365 illustrates the difficulty in determining the thresholds for 
multilevel data streams. From this simulation, it is apparent that the noise is signal 
dependent. Specifically, larger signal levels usually have a larger associated noise 
variance as is evidenced by the thickening of the eye-lids towards the top of the eye- 

30 diagram 365. It is desired to have voltage detection thresholds centered in the 
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statistical center of each of the 15 "eyes" 370. Furthermore, the eyes 370 are no 
longer uniformly distributed in voltage because the transmitter (with prior knowledge 
of the signal dependent noise variance) spaces the transmitted levels in a nonuniform 
manner in order to minimize the susceptibility to the noise and hence minimize the 
5 probability of error. 

Because the transmitted levels are not uniformly spaced, a simple 
conventional direct ADC 235 at the minimum number of bits (log2(16) = 4 in this 
case) is not adequate. Hypothetically, the received voltage signal could be digitized at 
a higher resolution (additional bits) and signal processing applied to determine the 
10 correct level. Unfortunately, at the targeted symbol rates of many optical systems (i.e. 
OC-192 at 10 Gb/s), this would require order-of-magnitude speed improvements of 
readily available ADC and signal processing technologies. 

Exemplary Embodiments for analog-to-digital converters (ADCs) and signal integrity 
15 units (SIUs) 

Referring now to Figure 4, this figure illustrates the details of an exemplary 
ADC 235 and a SIU 220. The ADC 235 may comprise a plurality of first 
comparators 405 connected in parallel to a decoder 410. The ADC 235 may be 
characterized as a high-speed low-resolution ADC that converts the received 

20 multilevel signal (symbols) into the associated transmitted data words or data 
channels. The threshold voltages of the comparators 405 are controlled by one or 
more digital-to-analog converters 415. The decoder 410 is coupled to an exemplary 
first latch 420 that may be four bit latch type. A second comparator 425 is connected 
in parallel with the first comparators 405. However, the second comparator 425 does 

25 not feed its output to the decoder 410. Instead, the output of the second comparator 
425 is fed into a second optional latch 430 which is controlled by the clock signal. 
The subcircuit comprising the second comparator 425 and the optional latch 430 is 
referred to as the event-detection circuit (EDC), as illustrated in Figure 4, since it 
produces a binary signal indicating if a particular event (in this case the event is 

30 whether exceeds v in as discussed later) has occurred. 
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The comparator 425 used in the EDC should ideally be identical to and in the 
same environment as the first comparators 405. This will allow for the SIU to 
accurately determine threshold settings of the ADC with a one-to-one voltage 
correspondence. Assuming that the ADC 235 is in the form of an integrated circuit 
5 (IC), the first comparators 405 and the second comparator 425 should be realized with 
the same basic circuitry and located in the same region of the IC to provide good 
thermal matching. In other words, the first comparators 405 and the second 
comparator 425 in this exemplary embodiment are manufactured on or within the 
same integrated circuit in order to improve thermal matching. 

10 The output of the second optional latch 430 is fed into a filter 435 that is part 

of the signal integrity unit 220. The output of the second optional latch 430 is called 
Event Detection (ED). After low-pass filtering by the LPF 435, the DC component 
remains and is termed the event monitor voltage v em and is an analog probability 
estimate for the controlled reference voltage exceeding the received signal V;„ 

15 where is generated by the digital-to-analog converters 415. Further details of the 
analog probability estimate v em and the controlled reference voltage v„> will be 
discussed below. 

The output of the second optional latch 430 can be fed to a second analog-to- 
digital converter 440 that is part of the signal integrity unit 220. Opposite to first 
20 ADC 235, the second ADC 440 may be characterized as a low-speed high-resolution 
ADC that measures the averaged event-detector output representing the CDF value. 
Specifically, the reference voltage v n , is swept over a range of voltage levels while the 
second ADC 440 samples the voltage v em from the filter 435 to produce an estimate of 
the CDF. 

25 More specifically, pseudo-code to construct the CDF. could comprise one or 

more of the following steps: Step 1: Set the reference voltage v„ to the minimum 
value of interest, i.e. lowest possible received voltage. This could be referred to as the 
start of the sweep. Step 2: Measure the averaged event-detector output voltage v em 
and take that value as the CDF value for the set reference voltage. Step 3: Increment 

30 the reference voltage. Step 4: If the reference voltage is above the maximum value of 
interest, a "sweep" has been completed and then the reference voltage is reset and the 
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process returns to Step 1. Otherwise, the process of "sweeping" continues and returns 
to Step 2. It is noted that a single point of the CDF (step 2) is obtained for each value 
of the reference voltage. 

Therefore, the SIU 220 sets Vp, to a fixed value and then measures the 
5 averaged ED output. The SIU 220 then sets to a different fixed value and 
measures another point of the CDF. This process is completed until the CDF curve is 
formed. 

The second ADC 440 feeds its output to a microcontroller 445. 
Microcontroller 445 processes the cumulative distribution function (CDF) to 
10 determine threshold voltage values for the first comparators 405. Further details of 
the microcontroller's processing of the CDF will be discussed below with respect to 
Figures 6A, 6B, and 9. The microcontroller 445 is responsible for feeding the 
threshold voltage values to the first comparators 405 for decoding the multilevel 
signal. 

15 Figure 4 illustrates a portion of a 16 level receiver 150, but it should be 

obvious to one skilled in the art that this circuit can be readily extended to any number 
of levels. For 16-levels (N=16) there is necessarily 15 (or N-l) voltage decision 
levels. 

Through the use of the second optional latch 430 in Figure 4, the portion of the 
20 signal analyzed can be restricted to the eye-opening sampled once each clock period. 
In this case, the resulting estimated cumulative distribution function (CDF) reports the 
distribution of received analog signal values at the sampling point used in the decision 
circuitry in the receiver 150, i.e. the signal timing used by the first comparators 405 is 
the same as that used by the EDC. This synchronization prevents other regions of the 
25 signal from corrupting the estimation process. 

Although the data rate of the received signal can be very high (e.g. on the 
order of tens of gigabits per second), receiver 150 of the present invention does need 
not sample the signal at this high rate to analyze the signal. The receiver 150 avoids 
this impediment by using the simple high-speed second comparator 425 that indicates 
30 whether a controlled reference voltage exceeds the received signal at the clocked 
sample time. The resulting binary signal can then be averaged in time with the analog 
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low-pass filter 435 to estimate the probability that the reference voltage exceeds the 
received signal. This probability estimate is a slowly-varying (ideally a constant) 
function and can thus be sampled with a high-resolution low-speed ADC 440. 

Referring now to Figure 5A, this figure illustrates another exemplary 
5 embodiment for an analog-to-digital converter (ADC) 235 f and SIU 220. Only the 
differences between Figure 4 and Figure 5A will be discussed below. According to 
this exemplary embodiment, the second optional latch 430 that can be coupled to the 
low-pass filter 435 has been removed. The removal of this latch can change the 
region of the signal that is being analyzed. Specifically, referring back to Figure 4, 
10 latching the output of the second comparator 425 focuses the CDF characterization to 
the portion of the signal synchronized with the system clock and decision output. By 
removing the latch as illustrated in Figure 5A, the statistical characterization applies 
to the entire received signal and not just that portion which is used for the decision 
output. 

15 Referring now to Figure 5B, this figure illustrates another alternative and 

exemplary embodiment for a multilevel receiver according to the present invention. 
In this exemplary embodiment, a high-resolution analog-to-digital converter (ADC) 
440' can measure the voltage of the received multilevel signal. The digitized 
multilevel signal can then be provided to a digital signal processor (DSP) 505. The 

20 DSP 505 can generate a CDF of the data in software using the digitized samples. 
Furthermore, the DSP 505 can incorporate the operation of the controller 445 in the 
SIU 220 to determine the decision thresholds. Then, instead of using the first 
comparators 405, decoder 410, and latch 420, the DSP 505 can perform the equivalent 
operations in software to identify each symbol of the multilevel signal. 

25 Referring now to Figure 5C, this figure illustrates another alternative and 

exemplary embodiment for a multilevel receiver according to the present invention. 
Only the differences between Figure 5C and Figure 4 will be discussed. Figure 5C 
differs from Figure 4 in the contents of the EDC. For the embodiment of Figure 5C, 
the event that the EDC detects corresponds to the received signal being between v„-A 

30 and Vrv+A Thus, for small values of A, the average of the EDC output corresponds to 
a pdf estimate. The embodiment in Figure 5C consequently bypasses the estimation 

-17- 



WO 02/082694 



PCTAJS02/11108 



of the CDF and directly estimates the pdf in the analog circuitry. The EDC in this 
exemplary embodiment comprises a pair of second comparators 574, 576 coupled to 
an AND gate 578. The EDC further comprises a second latch 430. As in Figure 5A, 
the optional latch may be removed from Figure 5C to pose another alternative 
5 embodiment (not shown or described herein). 

Exemplary Cumulative Distribution Function of Simulated Received Multilevel 
Signal 

Referring now to Figure 6A, this figure illustrates a graph 600 of an empirical 

10 cumulative distribution function (CDF) 605 for the received multilevel signal sampled 
at the eye openings 370 of Figure 3C. The CDF 605 is generated by taking the 
received signal v in (t) and comparing it (with second comparator 425) to a controlled 
reference voltage v„, to produce a binary signal that indicates whether the sampled 
signal is less than the set reference voltage. This binary signal may then be latched 

15 (through second optional latch 430) so that only eye-opening statistics are considered. 
The binary signal is then low-pass filtered (with filter 435) which corresponds to 
averaging in time. Thus, the low-pass filtered signal conveys the fraction of time (i.e. 
probability) that the received signal is less than the reference voltage. 

Generating this probability estimate over a range of reference voltages 

20 produces CDF 605 that can completely characterize the received signal. In particular, 
the estimated noise distribution (and hence threshold selection method) is free from 
restrictive assumptions such as Gaussianity and symmetry that, while commonly used, 
can be detrimental in some circumstances when dealing with multilevel data. But it is 
noted that the present invention can also function when Gaussian and symmetry 

25 conditions hold. 

Exemplary probability density function (pdf) derived from the CDF 

Referring now to Figure 6B, this figure illustrates a graph 610 of a probability 
density function (pdf) 615 that can be derived from the CDF 605 of Figure 6A. The 
30 microcontroller 445 of the signal integrity unit 220 can calculate this marginal pdf 
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615 as will be discussed below with respect to the method illustrated in Figures 9-14. 
As is evident from pdf 615, the noise incurred in transmission is signal dependent, e.g. 
the modes 620 of the pdf become shorter and wider as signal intensity increases. For 
such situations involving signal dependent noise, optimal transmission levels can be 
5 adapted to the noise in the channel to minimize the probability of error. This 
adaptation can be made by the transmitter 110. 

Referring now to both Figures 6A and 6B, the minimum number of required 
sample points of the pdf is 2N-1 where N is the number of symbols that can be 
transmitted. Specifically, at least 2AM reference voltages would be required to 

10 describe the N peaks in the pdf (one peak for each df the candidate symbols) and the 
N-] troughs (one for each pair of adjacent symbols). However, sufficiency of this 
minimal number of reference voltages generally requires that (i) the true underlying 
pdf be composed of symmetric and signal independent noise distributions, (ii) the 
transmission levels be uniformly spaced, and (iii) the estimation process be noise-free. 

1 5 None of these conditions are likely to be satisfied in practice, but their importance is 
vastly diminished as the number of reference voltages used is increased. In current 
practice, ADC technology is readily available to allow for high fidelity quantization 
(in excess of 14 bits or equivalently 4096 reference levels) for the sampling speeds 
required for the present invention. 

20 

Alternate Exemplary Embodiment for ADC and SIU of Figure 7 

Referring now to Figure 7, another alternate exemplary embodiment for the 
ADC 235" and SIU 220 M is illustrated. Only the differences between Figure 4 and 
Figure 7 will be discussed below. In this embodiment, the second comparator 425, 
25 latch 430, and low-pass filter 435 have been replaced with a holding circuit 705. 

In this exemplary embodiment, the CDF 605 and pdf 615 can be measured in a 
digital fashion (rather than the analog fashion described above) by using a holding 
circuit 705. The holding circuit 705 can comprise a track-and-hold circuit or a 
sample-and-hold circuit. The track-and-hold circuit or the sample-and-hold circuit of 
30 holding circuit 705 can sample an input multilevel data signal and accumulate the 
samples over time. These samples can then be digitally processed to provide either a 
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marginal pdf 605 or CDF 615. As before, the CDF 605 or marginal pdf 615 may 
then be used by the microcontroller 445 to determine the optimal decision threshold 
voltages for the comparators 405. 

5 Additional Eye Diagram and Corresponding Digitally Processed Histogram 

Referring now to Figures 8 A and 8B 5 Figure 8 A illustrates a graph 800 of time 
versus voltage depicting an exemplary "Eye"-diagram 805 for all 4,096 received 
symbols corresponding to a transmitted signal that could be similar to the transmitted 
signal 305 of Figure 3 A. Eye diagram 805 comprises the complete data set with all 

10 symbol periods overlaid on one another. Meanwhile, Figure 8B illustrates a 
histogram 810 of measured voltages for the received analog multilevel signal that is 
sampled at random points in time. This histogram 810 is an example of a pdf 
estimate. This histogram 810 is comprised of a finite number of the most recent "n" 
samples taken by the holding circuit 705. As a new sample is determined, the oldest 

1 5 is removed from the sample set. 

Ideally samples would occur at times centered temporally in the high-speed 
data stream's eyes. This would require critical timing requirements and therefore not 
be expected to be cost effective. Instead, the voltage samples can be easily made at 
random times thereby allowing for the elimination of all critical timing circuitry. The 

20 result of random signal voltage sample times is similar to the ideal sampling case due 
to the smaller probability of sampling during a signal transition. While not dominant, 
samples do occur during a signal transition which results in a data "floor" in the 
histogram, which can be removed during subsequent signal processing. 

Random sampling for this application means random to the high-speed data 

25 rate. This can be achieved by using a periodic sample rate, which is not harmonically 
related to the high-speed data rate. The actual average sample rate of the random 
voltage samples is dictated by the threshold update speed desired. If the 
communication channel is expected to vary quickly with time, the sample rate must be 
correspondingly high. As an example, assuming that the channel varies with a 10 ms 

30 characteristic time and 1000 samples forms the histogram; average conversion speed 
only need be 100,000 samples per second. 
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To produce the histogram 810 of Figure 8B, the microcontroller 445 can 
sample the received analog voltage of the multilevel signal by triggering the holding 
circuit 705 at some time random in relation to the received data stream. The holding 
circuit 705 will necessarily have a capture bandwidth commensurate with the high- 
5 speed data stream, but will only need to be able to sample at rate much lower than that 
of the high-speed data stream. The microcontroller 445 would then trigger the second 
ADC 440 conversion and record the resulting voltage. The microcontroller 445 can 
continue this process until adequate statistic information can be gathered to determine 
the appropriate decision levels. 

10 

Method For Decoding a Multilevel Signal 

Referring now to Figure 9, this figure is an exemplary logic flow diagram that 
illustrates a method 900 for decoding a multilevel signal according to the embodiment 
illustrated by Figures 2 and 4. Differences in implementation and operation compared 

15 to other embodiments are described after the full operation of the embodiment in 
Figures 2 and 4 is discussed. Certain steps in the processes described below must 
naturally precede others for the present invention to function as described. However, 
the present invention is not limited to the order of the steps described if such order or 
sequence does not alter the functionality of the present invention. That is, it is 
,20 recognized that some steps may be performed before, after, or in parallel with other 
steps without departing from the scope and spirit of the present invention. 

The method 900 starts with step 905 in which a multilevel signal is received 
by the first comparator 405 of a multilevel receiver 150. In step 907, the received 
multilevel signal is continuously sampled. Step 907 basically describes an approach 

25 where the multilevel signal is continuously observed in order to decode the received 
data. In other words, step 907 may describe a loop where the multilevel signal is 
continuously sampled while the remaining steps of Figure 9 are performed in parallel 
relative to the continuous sampling carried out in step 907. 

Next in routine 910, a cumulative distribution function (CDF) based upon 
30 previous symbols in the multilevel signal is calculated by the microcontroller 445 of 
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the signal integrity unit 220. Further details of routine 910 will be discussed below 
with respect to Figure 10. 

Next, in optional routine 915, a marginal probability density function (pdf) is 
calculated by the microcontroller 445 based upon the CDF calculated in routine 910. 
5 As noted above, a marginal pdf can be defined as an "overall 1 ' pdf that results from 
random symbols being received. A marginal pdf can comprise one or more 
conditional pdfs. A conditional pdf is a pdf associated or corresponding to an 
individual symbol of a multilevel signal. Routine 915 is optional since decision 
thresholds can be calculated from the CDF alone. Further details of routine 915 will 
10 be discussed below with respect to Figures 1 1 and 12. 

In routine 920, one or more decision thresholds based on at least one of the 
CDF and pdf can be determined. As mentioned previously, since the calculation of 
the pdf is optional, decision thresholds can be determined from a calculated CDF 
alone. The microcontroller 445 is usually responsible for performing routine 920. 
1 5 Further details of routine 920 will be discussed below with respect to Figure 13. 

In step 925, the microcontroller 445 associates a threshold voltage level with 
each determined decision threshold calculated in routine 920. The microcontroller 
445 forwards these voltage levels to the one or more first comparators 405 of the first 
analog-to-digital converter (ADC) 235. 
20 Next, in step 930, each first comparator 405 compares the received multilevel 

signal with the one or more threshold voltages supplied by the microcontroller 445. 
In step 935, the decoder 410 of the first ADC 235 decodes the multilevel signal into 
one or more data streams based upon the comparisons. 

In routine 940, the microcontroller estimates the fidelity of the received 
25 multilevel signal. Further details of routine 940 will be discussed below with respect 
to Figure 14. 

In step 945, the operation of the programmable analog signal processors 
located in the signal conditioning filter 215 can be adjusted by the microcontroller 
445 of the signal integrity unit 220 based upon the calculated fidelity in routine 940. 
30 For example, the weighting coefficients of a programmable delay line equalization 
filter could be adjusted to minimize the estimated probability of error inferred from 
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this fidelity measure. Similarly, a controllable delay on the clock timing may be 
adjusted to maximize the fidelity measure. 

Next in step 950, the gain of the entire system can be adjusted based on the 
range of received signal values inferred from the pdf as is discussed later. 

5 

Exemplary Embodiment of Sub-Method for Calculating Cumulative Distribution 
Function (CDF) 

Referring now to Figure 10, this figure illustrates exemplary steps for routine 
910 of Figure 9 that calculates a CDF according to the exemplary embodiment of the 

10 invention illustrated in Figure 4. Routine 910 starts with step 1005 in which a 
reference voltage is swept over a range of feasible voltage levels by the 
microcontroller 445 of Figure 4. During step 1005, the second comparator 425 and 
low-pass filter 435 generate an analog probability estimate v em for a controlled 
reference voltage v^. In other words, while sweeping v^, v em is measured. The 

15 measurement estimates the probability that the reference voltage exceeds the received 
signal. 

To understand why this occurs, consider the reference held at a constant 
voltage. The output of the second comparator 425 is a binary value equal to one if 
v in <Vry and equal to 0 otherwise. This output can thus be written as the indicator 
20 function lO^Vn,). The low-pass filter 435 (labeled LPF) then averages this function 
over time, i.e. it approximates the fraction of the time that v in is less than or in 
other words, it approximates the probability P(v/„<v„,). More precisely, 
= v ol +K-Avg[l(v in i£v„)] 

to Vrv 

« v ol + K ■ jj(v fc < v^pivjdv,, = v ot + jpiyjdv^ (1) 
= v ol +K-?(v in <v„) 

in which v o/ is the output voltage low state of the D-FF and K is a proportionality 
25 constant identical to the voltage swing from the D-FF (A=^ 0 /,-v 0 / where v oh is the 
output voltage high). 

Next in step 1010, the microcontroller 445 measures the resulting probability 
estimate in order to generate the CDF 605 illustrated in Figure 6A (which can be 
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converted to a more intuitive pdf as discussed with respect to Figure 12 below). The 
sub-method then returns to routine 915 of Figure 9. 

Exemplary Embodiment of Sub-Method for Calculating a Probability Density 
Function 

Referring now to Figure 12, this figure illustrates exemplary steps for routine 
915 of Figure 9 that calculates a pdf according to the exemplary embodiment of 
Figure 4. Routine 915 starts with step 1205 in which a first difference is calculated 
for the CDF 605 determined in routine 910. The first difference is generally the 
discrete time equivalent of a derivative. Specifically, for a sequence x[n], the first 
difference is the sequence x[n]-x[n-l]. The result is the histogram hfvn) (not shown). 

Unless a very large number of samples are used for each of the CDF points, 
there will be a considerable amount of statistical noise in the resulting pdf. Thus, step 
1215 smoothes the histogram h(v„) (not shown) by filtering the histogram along the 
reference voltage. Specifically, h(vry) is convolved with a boxcar function to filter 
the histogram along to produce the smoothed pdf g(v n >). This operation is 
motivated by regularity assumptions on the underlying noise distribution. 
Furthermore, the application of the differentiation (step 1205) and convolution to the 
CDF can be combined into one step, i.e. 



where P(v0 represents the CDF measured at voltage v fo R is the "radius" of the boxcar 
kernel, and A v is the spacing between voltage samples. Note that the calculation in 
Eq. (2) is no more computationally intensive than talcing a first difference (step 1205). 

In step 1220, the histogram g(v^) (not shown) can be smoothed along the time 
domain. Specifically, the histogram is smoothed along the time domain because 
should the pdf s vary slowly with time (if at all), by smoothing in time, more samples 
are being used (in an iterative framework) to estimate the probabilities without having 
to acquire many samples to generate each probability estimate. In essence, 
measurements of v em are being recycled to estimate the pdf. To be more precise, first 




(2) 
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consider the pdf evaluated for a particular voltage v 9 i.e. consider the pdf on a 
pointwise basis. For each iteration n, a pdf value g n (v) (i.e. the pdf smoothed along 
voltage) is measured providing a noisy measurement of the true pdf value p n (v) at 
time /?, i.e. the observation model is 

5 gn(v) = p„(v) + w n (v) (3) 

where w n (v) is sample noise which is assumed to be white, i.e. the inner product of 
w n (v) with w m (v) is a Dirac function. The evolution of the true pdf is modeled by the 
independent increments (and thus Markov) process 

Pn(v)=p n -l(v) + U n (v) (4) 

10 where u n (v) is another white noise process independent of w„(v). The optimal 
estimator for the system given by the state dynamics in Eqs. (3) and (4) is the 
recursive estimator 

9n&) = ccfgnfv) - q n -i(v)] + q n -i(v) (5a) 
= (l-a)q n -i(v) + ag n (v) (5b) 

15 where q n (v) denotes the pdf estimate at iteration n. Eq. (5a) is written in the form of a 
trivial Kalman filter (with Kalman gain a). Eq. (5b) is the Kalman filter rewritten in a 
form which makes the exponential memory decay of the process more explicit. 

The reader may wonder why using Eq. (5) is preferable to simply using more 
samples to generate each g n (y). Although both approaches can be used to provide an 

20 estimate with high statistical significance, the brute force method of simply using 
more samples requires an associated larger amount of time to acquire those samples. 
The state-space approach in Eq. (2.4) recycles information so that the time required to 
generate each g»(v) can be considerably reduced. Eqs. (2) and (5) provide a smoothed 
(in both voltage and time) pdf 615 from the CDF provided through v em . The 

25 smoothing (in either voltage or time) steps 1215 and 1220 are optional and may not be 
required if adequate statistical significance can be achieved in a reasonable amount of 
time. After generating and optionally smoothing the pdf 615, the process then returns 
to routine 920 of Figure 9. 
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Exemplary Embodiment of Sub-Method for Calculating Decision Thresholds 

Referring now to Figure 13, this figure illustrates exemplary steps for routine 
920 of Figure 9 that determines the one or more decision thresholds according to an 
exemplary embodiment of the present invention. To motivate the proposed 
5 methodology, the underlying analysis is presented here. It starts with a model of the 
received N-level signal. For each transmitted signal level x=A n (ne{0,...,N-l})> the 
received symbol y has an associated conditional pdf p(y \ x=A n ). This conditional pdf 
is the pdf for the received symbol conditioned on transmitting a particular level A n . 
When the transmitted level is not known (as is the case in realistic settings), the pdf 
1 0 characterizing the received symbol is the marginal pdf 

where it is assumed that all the symbols are equally likely to have been transmitted. 
To illustrate the structure of such a marginal pdf, Figure 15 illustrates the marginal 
pdf (as a measured histogram) for an 16-level signal transmitted through 25km of 
15 fiber. There are N=]6 clearly identifiable modes of the pdf associated with the N 
transmission levels. There will always be at least N such distinct modes in situations 
where signal detection is possible. This property will be exploited for the operation of 
the SIU. 

The manner in which the pdf s structure is exploited will be through the use of 
20 what this detailed description refers to as "e-supports". The support of a function f(x) 

is mathematically defined to be the set fx \f(x)>0} 9 i.e. where the function is strictly 

positive. This is generalized to define the ^-support of a pdf as 

Se = fy\p&)>s} (7) 

i.e. the e-support conveys the range of values of y that are likely to be observed. 
25 Furthermore, if the received signal is of reasonable fidelity (i.e. if the received 

symbols can be correctly detected with a low probability of error), then the s-supports 

for the each of the transmitted symbols do not overlap. Thus, a unique ^-support is 

identified with each conditional pdf, i.e. 

Sn,* = fy\p(y\x=Aj>e} (8) 
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that conveys the range of values of y that are likely to be observed when transmitting 
level A n . 

In practice, the conditional pdf s are usually unknown. However, an estimate 
p{y) of the marginal pdf can be obtained from the low-pass filtered event-detector 
5 output. Because the modes of the pdf are well separated (as in Figure 15), for links of 
reasonable quality, reliable estimates can be obtained of the conditional s-supports by 
taking them as the N regions composing the marginal ^-support S e . Specifically, the 
following three steps can be taken to obtain estimates of S„ (£ 

1. In step 1305, the observed pdf p(y) is normalized to have a peak value of 1, 
10 i.e. define 

9M = -^-r (9) 

V 

2. Next, in step 1310, q{y) is thresholded against e (which is normalized to the 
range 0<£<1), i.e. estimate S e as 

S £ = {y\q(y)>s) (10) 
1 5 where the resulting S E is a set of intervals or "regions". 

3. In step 1315, if there are more than N connected intervals composing S e , then 
iteratively merge the two regions that are "closest" together until only N 
regions remain, where the measure of "closeness" is given by the function: 

a-b 

for any two regions A t BeS £ where X A and X B are the lengths (i.e. Lebesgue 
measure) of A and B, respectively. By "merging" regions A and B 9 it means to 
take the convex hull of their union (i.e. if A=[a lam a hig} J t B=[b laxvt b higJ J, and 
ahigh<biow> then the merger is taken as [a low , 6/,^/J). 

Note that one skilled in the art will understand that a variety of functions can 
25 be used in place of Eq. (1 1) and still yield the desired result. All that is required is 
that the chosen function conveys a notion of the distance between sets. It should also 
be noted that step 1315 above has the additional benefit that if the data exhibits 
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multiple eye-lids or multiple-rails for a single transmitted symbol, then the merging 
will associate the multiple eye-lids according to their underlying common transmitted 
symbol. Specifically, link characteristics such as nonlinearities and intersymbol 
interference result in signal distortions that manifest themselves as multi-modal 
5 conditional pdf s (or equivalently multiple eye-lids when the data is viewed as an eye- 
diagram). The multiple modes result in extra, but closely spaced, regions in S e . The 

merging in step 1315 combines these multiple modes according to the underlying 
transmitted symbol. 

In step 1320, possible threshold candidates are determined based upon the 

10 combined remaining regions of the e-supports. Specifically, having estimated N &■ 
supports (each associated with one of the possible signal levels A„), the following 
describes how the thresholds are set between the regions. First, each of the 
conditional pdf s p(y\x=A n ) are modeled as a Gaussian (more to be said about the 
Gaussian modeling and application to non-Gaussian noise at the end of this 

15 subsection). In particular, for each transmitted signal level x=A n (ne{0,...,N-l}) 9 the 
received symbol y is modeled with the conditional pdf 

p(y | x=AJ = <p(y; ^ a t1 ) (12) 
where <p(y; ^ <r,J is the Gaussian pdf with mean jj„ and standard deviation a„, i.e. 

•O'-M,,) 2 



<P(y>Hn>°»)= r— exp 
V2rcc7 n 



2cr 2 



03) 



20 Because each conditional pdf is assumed to be Gaussian, it is characterized by the 
conditional mean }i n and standard deviation cr„. These two parameters are unknown 
quantities which must be estimated from the received data. To do this, the observed 
marginal pdf p(y) and the s-supports S n c are used. Specifically, step 1320 can 
comprise the following substeps: 

25 1. Compute the empirical mean and standard deviation based on p(y) but 

restricted to the domain where y is in S n £ , i.e. 
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[ yp(y) dy 

ft- r ~, z 2 (14) 



a = 



(15) 



2. The quantities pf n and a n correspond to the mean and standard deviation of y 
conditioned on the events that (i) level A„ was transmitted and (ii) the received 

A. 

value y lies in the set S n e . However, the parameters /i„ and or,, that are desired 

are the mean and standard deviation conditioned only on the event that level 
A n was transmitted (i.e. the range of y is not restricted). To obtain this 
quantity, Ji n and a n are scaled appropriately with the set S n e to unbias the 

estimates. Using the appropriate normalization, this produces potential 
estimates of /j„ and a„ as 

fin = Mn , (16) 

^erf^ln(l/e)) 

where Eq. (16) implies that Ji n is already appropriately normalized. However, 
the estimate given by Eq. (17) is not used as it is written for the following 
reason. Even though e is a user- specified parameter, its use in Eq. (17) is not 
quite correct. Specifically, recall that the threshold s is applied to the marginal 
pdf in contrast to the conditional pdf for level A„. Because the true standard 
deviation <j n will likely vary among the different levels, the specified £ is 
correctly normalized only for the conditional pdf with the largest peak (i.e. 
smallest <7„), and the use of this value of e for all «, is inappropriate. To 
correct for this level dependent fluctuation in £, the value of € is estimated for 
each level A n from the empirical probability measure of the associated e- 
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support region. One skilled in the art can calculate this revised value of e as 
£„=exp 



-erfin^^p( 7 ) 4vjj.(18) 



Thus, in computing 6 n , e n is used as defined by Eq. (18) instead of the user- 
specified s. 

5 These steps provide fx n and cf n for all /?, and thus, a characterization of all the 
conditional pdf s. 

Figures 16-17 (for a 16-level signal) show the results of this procedure on the 
data in Figure 15. The measured pdf is shown in the solid curve. The difference 
between the measured pdf and the Gaussian mixture model (i.e. the modeling error) is 

10 shown with the dotted curve. Figure 16 shows the modeling error for the Gaussian 
model when the parameter estimates are given by Eqs. (16) and (17) without the 
correction for s; Figure 17 shows the error when the parameter estimates include the 
s correction in Eq. (18). The improvement from using s n is negligible for larger 
values of v in (since e is already approximately correct), but the improvement is 

1 5 significant for smaller value of v in where there are large differences among the <t„, and 
hence e. 

Figures 18-19 show the log-likelihood ratio (LLR) of the measured pdf to the 

modeled pdf. The information content is the same as that in Figures 16 and 17, but 

because the LLR is used in place of the difference, the plot emphasizes the goodness 
20 of fit in the tails of the distribution. From Figures 18-19, it is seen that the Gaussian 

model does provide an accurate fit in the tails of the distribution down to the floor 

associated with the limited amount of data. 

Referring back to Figure 13, as an alternative approach to estimating and 

<7„, instead of using an approach based on the empirical statistics in Eqs. (14) through 
25 (17), the parameters can be estimated directly from the location and length of the e- 

support S njE . Specifically, denoting S n e as the closed interval [a, b], the conditional 

mean can be taken as 

fi n =(a+b)/2 (19) 
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and the conditional standard deviation as 

b—a 

o„= . (20) 

As with Eq. (17), the estimate in Eq. (20) can be improved by using e n from Eq, (18) 
in place of e. 

5 Using the Gaussian model and estimated parameters fi n and <j n the decision 

thresholds can now be proposed. The nature of noise in communications channels is 
that the noise perturbations are usually small rather than large. Not only is this the 
case for the Gaussian noise model, but for many other noise models as well. For this 
reason, in this and the following section, we consider only symbol errors associated 

10 with an adjacent level. These types of en'ors dominate the link performance 
characterization. Thus, it is sufficient to consider each pair of adjacent transmissions 
in a conventional on-off keying (OOK) context. In particular, the optimal threshold to 
differentiate levels A n and A n +j is well approximated by 

15 which has an associated probability of error of 

Pr(error between symbols n and «+/ | x=A„) 

= Pr(error between symbols n and w+7 | x=A n +j) 



= — erfc 
2 



(O \ 



\ V2 

where Q n>n +j is the traditional Q-factor estimate 



(22) 



20 = f n - (23) 



The statistical analysis of routine 920 will usually be continually performed; 
thereby adjusting the decision levels in real time to compensate for time varying 
distortion/noise of the received signal. After, routine 1320, the process for the current 
iteration returns to step 925 of Figure 9. 
25 Prior to moving onto the next subsection, the robustness of the Gaussian 

model is discussed. Like much of the conventional art, the conditional pdfs are 
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modeled as Gaussian. However, because of the use of the s-supports to estimate the 
parameters of the Gaussian pdfs, the method still performs well in situations where 
the data is not Gaussian distributed. Specifically, recall that the first step of the 
analysis is to compute N e-support regions to characterize the region of significant 
5 probability for the conditional pdfs. Thus, if the e-supports are correctly associated 
with the conditional pdfs, then the thresholds will be established in the tails of the 
pdfs thus producing a low-probability of error. Fortunately, the method proposed in 
Eqs. (9)-(ll), and the surrounding text, should easily and correctly determine the e- 
supports because the modes of the pdfs will be well separated in realistic 
10 communications systems. Thus, even though a Gaussian model is used to establish 
the thresholds in this sub-section, the use of the e-supports to determine the 
parameters still allow for non-Gaussian distributions (such as multi-modal 
distributions) to be handled as well. 

1 5 Exemplary Embodiment of Sub-Method for Estimating Link Fidelity 

Referring now to Figure 14, this figure illustrates exemplary steps for routine 
940 of Figure 9 that estimates the fidelity of a multilevel signal according to an 
exemplary embodiment of the present invention. Routine 940 starts with step 1405 in 
which a conditional probability density function (pdf) is estimated for each symbol of 
20 the multilevel signal. Next, in step 1410, the probability of error for the entire system 
can be calculated. Specifically, the "wellness" of the data may be output as a voltage 
Vf x d that conveys signal fidelity to analog signal conditioning circuits to provide an 
. improved eye opening for reduced error rate. 

This sub-method allows for error performance to be gauged without explicit 
25 data error tests that can only be performed in artificial settings where the transmitted 
values are known. Specifically, using the above statistical characterization of the 
received data, the performance of the link can be estimated using random data. 
Efforts in the conventional art usually estimate the error rate of the link by 
transmitting a testing sequence of data (already known to the receiver) which is 
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10 



15 



detected by the receiver. The receiver of the conventional art then counts how many 
decoding errors were encountered. 

The proposed method, in contrast, leverages the probabilistic modeling of the 
system to estimate link error rates without the transmission of a predetermined testing 
sequence. In particular, the error rate can be estimated while receiving random data 
during real-world operation by exploiting Eq. (22). Specifically, the overall link 
symbol error rate can be obtained by averaging the probability of symbol error 
conditioned on a given transmitted symbol yielding: 

Pr(enror) = -l|;Pr(errorM rt ) 



n-0 



= -U Pr(error 1 4, ) + Pr (error | A N ^ ) + ]T Pr(eiror | A„ ) 
iV L ««i 



| + erfc 



(24) 



1 V *Jl 



V2 J 



Eq. (24) provides the symbol error probability. If desired, one can convert this to a bit 
error probability. Specifically, if a Gray-coding scheme is used for the binary 
representation of the data, then each symbol error between adjacent levels produces a 
single bit error. Considering that signals composed of N levels require to log2N bits 
for their binary representation, this yields a bit error probability of 



d/uv \ ^(symbol error) 
P(bit error) = — — - 

log 2 N 

1 *-2 ( O 

1 -Eerfc^' 



(25) 



Nlog 2 N to 

This bit error probability can then be converted into an "effective" Q-factor (i.e. the Q 
value of an OOK system that has the same bit error rate as the multi-level system) via 
Q € = 72 erfcinv(2Pr(bit error)) 



(N 2 > 
V erfcfa, n+ . / V2 ) 
AT log, N W "'" +l/ ' 



(26) 
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The reliability measures in Eqs. (24)-(26) are all equivalent, and thus, any of these 
three can serve as a fidelity measure of the channel reliability. However, the effective 
Q-factor of Eq. (26) is more practical for implementation because it is less susceptible 
to circuit noise. Specifically, the error rate of the link is expected to be near zero, and 
5 if either the bit or symbol error probability were used as the fidelity measure, then a 
small amount of noise in the circuitry would drown out the fidelity measure signal. 
The process then returns to step 945 of Figure 9. 

Referring now to Figure 20, this figure illustrates the measured pdf for N=16 
level data received through 25km of fiber. The line 2400 slicing through the pdf in 

10 Figure 20 denotes the value of s used to determine the e-supports (i.e. the regions 
where the pdf exceeds e). Thresholds (obtained from Eq. (21)) are shown as vertical 
dashed lines with the associated Q-factor (from Eq. (22)) for each pair of adjacent 
levels. The effective Q-factor (from Eq. (26)) for the multi-level system is 3.1. 

The validity of Eqs (22>(26) is strongly dependent on the Gaussian model. If 

15 the noise is not Gaussian, then the Q-factor does not give the probability of error as 
stated. However, in the non-Gaussian case, the method still supplies an intuitive 
quantification of the fidelity of the received signal which is related to the probability 
of decoding error. Thus, while the numerical value provided by the fidelity measure 
may not exactly relate to detection error probability, it still characterizes the fidelity of 

20 the link, i.e. large numerical values indicate better signal fidelity. 

Exemplary Embodiment of Sub-Method for Gain Control 

Referring back to step 950, because the 8-support regions calculated in routine 
920 represent all the voltage ranges where a candidate symbol is likely to be received, 

25 the e-supports can be used to determine an appropriate gain normalization factor for 
the received signal. In particular, the largest and smallest voltages among all of the e- 
support regions represents the largest and smallest voltage likely to be received for a 
symbol transmission. These extreme values can thus be used to provide appropriate 
gain to scale the received signal such that the entire voltage swing of the system is 

30 utilized. 
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Specifically, the automatic gain voltage V agc can be taken as the reciprocal of 
the size of the convex hull of all of the e-support regions, i.e. 

V m = (27) 

max{max{a} } - min{min{a} } 

A aeA A aeA 

where A represents the various e-supports associated with each level, and thus the 
denominator represents the peak-to-peak voltage of the received signal. 



Alternative Exemplary Embodiment of Method for Decoding Multilevel Signals of 
Figure 5A 

Having given a detailed description of the embodiment illustrated by Figures 2 
and 4, the embodiment given by the use of Figure 5A in place of Figure 4 is now 
discussed. The operation and implementation of this embodiment follows exactly as 
for Figure 4 except that the second latch 430 is removed. Thus the statistical 
characterization upon which all the analysis is based covers the entire time span of the 
signal and not just the portion synchronized with the first plurality of comparators 
405. 

Alternative Exemplary Embodiment of Method for Decoding Multilevel Signals of 
Figure 5B 

The embodiment given by the use of Figure 5B in place of Figure 4 is now 
discussed. This embodiment differs from that illustrated in Figure 4 in the following 
manner. First, step 910 is omitted as the alternative embodiment directly can 
calculate the pdf. This is done by sampling the signal with the ADC 440' which 
passes the samples onto the DSP. ADC 440' samples at the symbol rate with a high 
resolution. These samples are used both to decode the received symbol and produce 
the statistical characterization in the DSP. The DSP collects the data samples and can 
digitally generate the pdf estimate. The remaining steps 920-950 can also be absorbed 
into the DSP thereby obviating the need for the controller 445 in the SIU 220. 
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Alternative Exemplary Embodiment of Method for Decoding Multilevel Signals of 
Figure 5C 

The embodiment given by the use of Figure 5C in place of Figure 4 is now 
discussed. The operation and implementation of this embodiment is identical to that 
for Figure 4 except that the filtered ED output v em produces an estimate of the 
marginal pdf rather than the CDF. To see why this occurs, note that the only 
difference between Figures 4 and 5C are in the EDC. For Figure 5C, the pair of 
second comparators 574, 576 produce as outputs the indicator functions JfvnrA^^) 
and i^v in <v rv +/V. Thus, the quantity going into the low-pass filter 435 is the binary 
function ifv rv -^<v,> 1 <v r v+4^. Averaging this function over time produces the 
probability estimate P(V rv -4<v I>7 <v rv H-4) which is approximately proportional to the 
pdf p(v in ) for small values of A. Thus, step 910 is omitted for this embodiment and 
the embodiment is the same as that for Figure 4 in all other respects. 

Alternative Exemplary Embodiment of Method for Decoding Multilevel Signals of 
Figures 7 and 1 1 

Referring now to Figure 1 1, this figure illustrates exemplary steps for routine 
915 of Figure 9 that calculates a pdf according to the alternate exemplary embodiment 
associated with Figure 7. The steps of routine 915 correspond with the action taken by 
the ADC 235" and track-and-hold 705 illustrated in Figure 7. It is noted that step 910 
of Figure 9 for the exemplary embodiment of Figure 7 may be omitted. 

Routine 915 starts with step 1105 in which the holding circuit 705 in 
combination with the ADC 220" measure the voltage of the received multilevel 
signal. Specifically, microcontroller 445 can sample the received analog voltage of 
the multilevel signal by triggering the holding circuit 705 at some time random in 
relation to the received data stream. The holding circuit 705 will necessarily have a 
capture bandwidth commensurate with the high-speed data stream, but will only need 
to be able to sample at rate much lower than that of the high-speed data stream. 
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Next in step 1110, the microcontroller 445 would then trigger the second ADC 
440 conversion and record the resulting voltage. In step 1115, the microcontroller 
445 can collect the digitized measurements of the voltages and obtain the histogram 
810 of measured voltages as illustrated in Figure 8B. Histogram 810 is an instance of 
5 a pdf estimate. The microcontroller 445 can continue this process until adequate 
statistic information can be gathered to determine the appropriate decision levels. The 
process then returns to routine 915 of Figure 9. 

CONCLUSION 

10 The present invention uses a robust approach to setting the decision thresholds 

that assumes neither unimodality nor symmetry of the noise distributions but can also 
operate even if these assumptions hold. The invention exploits the estimated pdf and 
localized nature of the noise to detect regions of significant probability. Each of these 
regions should correspond to where a candidate symbol / should be declared in the 

15 decision process, i.e. each region determines the support of the conditional pdfs 
composing the observed marginal pdf. In cases where the number of regions exceeds 
the number of symbols (as may occur due to multi-modal noise distributions and 
estimation errors), the invention systematically merges regions based on prior 
knowledge that (i) redundant eyelids are spaced very close together (relative to the 

20 spacing between eye-lids associated with differing symbols) and (ii) the number of 
candidate symbols is a known system parameter. 

Further, the voltage decision thresholds produced by the algorithm are used by 
the fifteen high-speed comparators, which are followed by combinational logic to 
properly decode the levels back to the encoded data streams. The fifteen comparators 

25 and combinational logic are closely related to a traditional flash ADC with the 
exception of optimal threshold control (as per present invention) and decoding 
methods more amenable to communication systems other than binary. The receiver 
150 converts the 16-level input into properly decoded data streams. 

As noted previously, it should be obvious to one skilled in the art that the 

30 simple circuits illustrated in Figures 4, 5, and 7 can be expanded to AMevel 
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transmissions by incorporating N-7 high-speed comparators, adapting the decoding 
logic, and a higher resolution low-speed ADC for statistic signal sampling. 

One skilled in the art can appreciate that the methods described here can be 
applied to other modulation schemes other than iV-PAM. Examples of such 
modulation schemes are phase shift keying, frequency shift keying, and combinations 
methods such as quadrature amplitude modulation. The extension of the proposed 
method simply involves the appropriate change of the control variable in the CDF/pdf 
estimation. Because no restrictive form the noise distribution is assumed, the present 
invention will adapt to the different data distribution associated with other modulation 
schemes, which the conventional art cannot. 

While it is contemplated that the present invention is very suitable for optical 
networking environments, it can be appreciated that the present invention could be 
easily employed in fields involving lower-speed communications. For example, 
lower-speed communication fields can include, but are not limited to, wireless 
applications, and applications utilizing modems such as telephone, digital subscriber 
lines (DSL), and analog or digital cable. 

It should be understood that the foregoing relates only to illustrate the 
embodiments of the present invention, and that numerous changes may be made 
therein without departing from the scope and spirit of the invention as defined by the 
following claims. 
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CLAIMS 

What is claimed is: 

5 1. An optical receiver for receiving and decoding a multilevel 

optical communication signal, comprising: 

a plurality of first comparators for estimating a transmitted 
level based on the received multilevel signal; 

a decoder coupled to the first comparators; 
10 a second comparator connected in parallel with the first 

comparators, for indicating when the received signal exceeds a voltage; 

a filter coupled to the second comparator, for calculating a 
cumulative distribution function for the received multilevel signal; 

an analog-to-digital converter coupled to the filter for sampling 
15 a cumulative distribution function; and 

a microcontroller for processing the cumulative distribution 
function to determine threshold voltage values, for feeding the threshold voltage 
values to the first comparators for decoding the multilevel signal. 

20 2. The optical receiver of claim 1, wherein the multilevel signal 

comprises at least two levels. 

3. The optical receiver of claim 1, further comprising a latch 
coupled between the second comparator and the filter, the latch passing a portion of 

25 the thresholded signal to the filter, the portion of the signal being synchronized with a 
clock and the plurality of first comparators. 

4. The optical receiver of claim 1, wherein the first comparators 
and the second comparator are manufactured on a single integrated circuit chip. 

30 
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5. The optical receiver of claim 1, wherein the microcontroller 
further calculates a probability density function based on the cumulative distribution 
function. 

5 6. The optical receiver of claim 1, wherein the microcontroller 

further estimates a conditional probability density function associated with each 
symbol of the multilevel signal based on an associated e-support region and 
determines a probability of error for the channel based upon the conditional 
probability density functions and decision thresholds. 

10 

7. The optical receiver of claim 6, further comprising 
programmable analog signal processing modules that process the multilevel signal 
prior to the comparators, where the microcontroller selects an operating point of the 
programmable analog signal processing modules based upon the determination of the 

1 5 fidelity measure of the multilevel signal. 

8. The optical receiver of claim 7, wherein the analog signal 
processing modules comprise one of an equalizer and signal conditioning filter. 

20 9. The optical receiver of claim 7, wherein the analog signal 

processing modules comprise a clock recovery circuit. 

10. The optical receiver of claim 1, wherein the filter averages the 
output of the second comparator over time. 

25 

11. The optical receiver of claim 1, wherein the microcontroller 
iteratively sets a reference voltage and samples the voltage from the filter, wherein the 
microcontroller sweeps the reference voltage over a range of voltage levels in order 
to generate the cumulative distribution function. 

30 
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12. An optical receiver for receiving and decoding a multilevel 
optical communication signal, comprising: 

a plurality of first comparators for estimating a transmitted 
level based on the received multilevel signal; 

a decoder coupled to the first comparators; 

a pair of second comparators connected in parallel with the first 
comparators, to indicate when the received signal falls within controlled voltage 
ranges; 

a logic circuit coupled to the second comparators, to indicate 
when the received signal is in the intersection of the two controlled voltage ranges; 

a filter coupled to the logic circuit, for calculating a probability 
density function for the received multilevel signal; 

an analog-to-digital converter coupled to the filter for sampling 
a probability density function; and 

a microcontroller for processing the probability density 
function to determine threshold voltage values, for feeding the threshold voltage 
values to the first comparators for decoding the multilevel signal. 

13. The optical receiver of claim 12, wherein the multilevel signal 
comprises at least two levels. 

14. The optical receiver of claim 12, further comprising a latch 
coupled between the second pair of comparators and the filter, the latch passing a 
portion of the thresholded signal to the filter, the portion of the signal being 
synchronized with a clock and the plurality of first comparators. 
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15. The optical receiver of claim 12, wherein the microcontroller 
further estimates a conditional probability density function associated with each 
symbol of the multilevel signal based on an associated e-support region and 
determines a probability of error for the channel based upon the conditional 

5 probability density functions and decision thresholds. 

16. The optical receiver of claim 15, further comprising 
programmable analog signal processing modules that process the multilevel signal 
prior to the comparators, where the microcontroller selects an operating point of the 

10 programmable analog signal processing modules based upon the determination of the 
fidelity measure of the multilevel signal. 

17. The optical receiver of claim 16, wherein the analog signal 
processing modules comprise one of an equalizer and signal conditioning filter. 

15 

18. The optical receiver of claim 16, wherein the analog signal 
processing modules comprise a clock recovery circuit. 

19. The optical receiver of claim 12, wherein the filter averages the 
20 output of the logic circuit over time. 

20. The optical receiver of claim 12, wherein the microcontroller 
iteratively sets a reference voltage and samples the voltage from the filter, wherein the 
microcontroller sweeps the reference voltage over a range of voltage levels in order 

25 to generate the probability density function. 
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21. A desymbolizer for receiving and decoding a multilevel optical 
communication signal, comprising: 

an analog-to-digital converter for receiving and decoding the 

multilevel signal; 

a signal integrity unit coupled to the analog-to-digital converter 
for calculating and controlling one or more threshold voltages supplied to the analog- 
to-digital converter, for calculating at least one of a cumulative distribution function 
and a probability density function derived from the multilevel signal and associated 
with the one or more threshold voltages. 

22. The desymbolizer of claim 21, wherein the analog-to-digital 
converter comprises a holding circuit for sampling the multilevel signal in response to 
control signals generated by the signal integrity unit. 

23. The desymbolizer of claim 21, wherein the analog-to-digital 
converter comprises: 

a plurality of comparators for receiving the multilevel signal; 

and 

a decoder coupled to the outputs of the first comparators. 

24. The desymbolizer of claim 21, wherein the analog-to-digital 
converter is a first analog-digital converter, and the signal integrity unit further 
comprises: 

a digital-to-analog controller coupled to inputs of respective 
comparators located in the first analog-to-digital converter; 

a microcontroller coupled to the digital-to-analog controller for 
controlling a threshold voltage of each comparator located in the first analog-to- 
digital controller; 

a second analog-to-digital converter coupled to the first analog- 
to-digital controller and microcontroller of the signal integrity unit, for converting the 
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signals received from the first digital-to-analog controller and for feeding the 
converted signals to the microcontroller for statistical analysis. 

25. The desymbolizer of claim 24, wherein the output of the first 
5 analog-to-digital converter is coupled to a low-pass filter and the output of the low- 
pass filter is coupled to the second analog-to-digital converter. 

26. The desymbolizer of claim 22, wherein the holding circuit 
comprises one of a track-and-hold circuit and a sample-and-hold circuit. 

10 

27. The desymbolizer of claim 22, wherein the holding circuit 
samples the multilevel signal at random intervals. 

28. The desymbolizer of claim 22, wherein the holding circuit 
15 samples the multilevel signal at a periodic sampling rate wherein the period is an 

integer multiple of the symbol period. 

29. The desymbolizer of claim 22, wherein the holding circuit 
samples the multilevel signal at a periodic sample rate that is not harmonically related 

20 to a data rate of the multilevel signal. 

30. The desymbolizer of claim 21, wherein the signal integrity unit 
further calculates a conditional probability density function for each symbol of the 
multilevel signal based e-support estimates. 

25 

31. The desymbolizer of claim 30, wherein the signal integrity unit 
further determines a probability of error for a channel based upon the conditional 
probability density function and threshold levels. 



30 32. The desymbolizer of claim 21, further comprising 

programmable analog signal processing modules that equalizes and optimally filters 

-44- 



WO 02/1)82694 



PCT/US02/11108 



the multilevel signal prior to the analog-to-digital converter, where the signal integrity 
unit selects an operating point of the programmable analog signal processing modules 
based upon the determination of the fidelity of the multilevel signal. 

33. The desymbolizer of claim 32, wherein the analog signal 
processing modules comprise at least one of an equalizer and signal conditioning 
filter. 

34. The desymbolizer of claim 32, where the analog signal 
processing modules comprise at least one clock recovery circuit. 
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35. A method for receiving and converting a multilevel signal into 
a plurality of data streams, comprising the steps of: 
receiving a multilevel signal; 

calculating one of a cumulative distribution function and a 
5 probability density function based on the received multilevel signal; 

determining one or more decision thresholds based upon one of 
the cumulative distribution function and probability density function; 

associating one or more threshold voltage levels based on the 

decision thresholds; 

10 comparing the multilevel signal with the threshold voltage 

levels; and 

decoding the multilevel symbol into one or more bits based on 
the comparison of the multilevel signal with the threshold voltage levels. 

15 36. The method of claim 35, further comprising the step of 

calculating both a cumulative distribution function and probability density function, 
the probability density, function being derived from the calculated cumulative 
distribution function. 

20 37. The method of claim 35, further comprising the step of 

determining one or more decision thresholds positioned at local minima in a 
calculated probability density function. 

38. The method of claim 35, further comprising the steps of: 
25 estimating a conditional probability density function for each 

symbol of the multilevel signal; and 

determining a probability of error for the multilevel signal 
based upon the conditional probability density function of each symbol and the 
decision levels. 

30 
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39. The method of claim 38, further comprising the step of 
selecting an operating point of programmable analog signal processing modules based 
upon the determination of the probability of error for the multilevel signal. 

40. The method of claim 35, further comprising the step of 
assigning threshold voltage levels to respective comparators of a plurality of 
comparators. 

41. The method of claim 35, wherein the step of receiving a 
multilevel signal further comprises receiving a multilevel signal where the level 
corresponds to one of an amplitude, phase, or frequency that has been modulated 
according to the transmitted symbol. 
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42. A method for determining threshold voltages of comparators in 
a multilevel signal receiver system, comprising the steps of: 

estimating a probability density function; 

determining one or more statistical centers positioned on local 
minima that are present in the probability density function; and 

associating one or more threshold voltage levels based on the 
one or more statistical centers positioned according to the local minima. 

43. The method of claim 42, further comprising the step of 
estimating a cumulative distribution function based on a received multilevel signal. 

44. The method of claim 43, wherein the step of estimating a 
cumulative distribution function farther comprises sampling voltages with a periodic 
sample rate. 

45. The method of claim 42, wherein the step of estimating the 
probability density function comprises directly computing the probability density 
function from the received multilevel signal by collecting sampling voltage levels of 
the multilevel signal at random time intervals. 
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46. A method for receiving and converting a multilevel signal into 
a plurality of data streams, comprising the steps of: 

receiving a multilevel signal; 

determining one or more decision thresholds by calculating an 
5 initial set of ^-support estimates; 

associating one or more threshold voltage levels based on the 

decision thresholds; 

comparing the multilevel signal with the threshold voltage 

levels; and 

10 decoding the multilevel symbol into one or more bits based on 

the comparison of the multilevel signal with the threshold voltage levels. 

47. The method of claim 46, where in the determining one or more 
decision thresholds further comprises normalizing a cumulative distribution function. 

15 

48. The method of claim 46, where in the determining step further 
comprises combining s-supports. 

49. The method of claim 46, further comprising calculating a 
20 cumulative distribution function based on the received multilevel signal. 
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50. A desymbolizer for receiving and decoding a multilevel optical 
communication signal, comprising: 

an analog-to-digital converter for measuring a voltage of the 

multilevel signal; and 

5 a digital signal processor for calculating a probability density 

function derived from the multilevel signal and for identifying two or more signals 
that form the multilevel signal based upon the probability density function. 

51. The desymbolizer of claim 50, wherein the digital signal 
1 0 processor calculates a cumulative distribution function instead of a probability density 

function. 

52. The desymbolizer of claim 50, wherein the digital signal 
processor executes software to identify the two or more signals that form the 

15 multilevel signal. 

53. The desymbolizer of claim 50, wherein the digital signal 
processor determines the threshold voltages for the received multilevel signal. 
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54. A method for determining a set of decoding thresholds from a 
marginal probability density function comprising the steps of: 

thresholding the probability density function to obtain an initial 
set of intervals conveying regions of significant probability for received signal; 
5 calculating e-support regions by merging intervals until the 

number of regions is substantially equal to the number of candidate symbol 
transmission levels; 

associating each s-support region with a mode of a conditional 
probability density function corresponding to a transmission level; and 
10 computing a decision threshold based on the conditional 

probability density functions. 

55. The method of claim 54, wherein the step of calculating s- 
support regions comprises iteratively merging intervals wherein a pair of closest 

15 intervals is merged and a measure of closeness conveys a notion of distance between 
sets. 



56. The method of claim 55, wherein closeness is defined by the 
minimum distance between any two points in the set, the distance between two sets A 

20 and B being defined as 

d(A,B)= min la-fcl. 

57. The method of claim 55, wherein closeness is defined by a 
minimum weighted-distance between any two points in the set, the weighted-distance 

25 between two sets A and B being defined as 



d(A,B) = min 

aeAJ>eB 



a-b 



where X A and X B comprise lengths or Lebesgue measures of A and B, 

respectively. 
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58. The method of claim 54, wherein the step of calculating e- 
support regions further comprises merging any two regions A and B by taking a 
convex hull of their union. 

59. The method of claim 54, further comprising the step of 
associating each e-support with a Gaussian conditional probability density function. 

60. The method of claim 54, wherein the step of computing a 
decision threshold comprises determining a midpoint between e-support regions. 

\ ) 

61. The method of claim 54, wherein the step~'of computing a 
decision threshold comprises determining a weighted midpoint between E-support 
regions. 

62. The method of claim 54, further comprising the step of 
calculating an error rate for each transmitted symbol by using the calculated 
conditional probability density functions and the determined thresholds. 

63. The method of claim 54, further comprising the step of 
estimating an aggregate error rate for a communication link based upon each error 
rate calculated for each of the symbols. 

64. The method of claim 54, further comprising the step of 
determining a gain control to be applied to the received signal based upon calculated 
e-supports. 
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65. The method of claim 63, further comprising the step of 
determining an automatic gain voltage V ag c, the automatic gain voltage V agc 
comprising a reciprocal of a size of a convex hull of all of the e-support regions 
calculated wherein: 



agc max{max{a} } - min{min{a} } 

A aeA A aeA 

and where A represents e-supports. 



-53- 



WO 02/082694 



PCT/US02/11108 



66. A system for receiving and converting a multilevel signal into a 
plurality of data streams comprising: 

means for determining one or more decision thresholds by 
calculating an initial set of ^-support estimates; 
5 means for associating one or more threshold voltage levels 

based on the decision thresholds; 

means for comparing the multilevel signal with the threshold 

voltage levels; and 

means for decoding the multilevel symbol into one or more bits 
10 based on the comparison of the multilevel signal with the threshold voltage levels. 

67. The system of claim 66, wherein the means for determining one 
or more decision thresholds further comprises means for normalizing a cumulative 
distribution function. 

15 

68. The system of claim 66, wherein the means for determining one 
or more decision thresholds further comprises means for combining e-supports. 

69. The system of claim 66, further comprising means for 
20 calculating a cumulative distribution function based on the received multilevel signal. 

70. The optical receiver of claim 12, wherein the first comparators 
and the second comparators are manufactured on a single integrated circuit chip. 

25 
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